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METHOD AND SYSTEM FOR INITIALIZING 
A TRAINING PERIOD IN A TURBO DECODING DEVICE 
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CROSS REFERENCE TO RELATED APPLICATIONS 
This application claims the benefit of provisional U.S. Patent 
Application No. 60/258,9741 filed December 29, 2000, to inventors 
Blankenship et ai. (Attorney Docket No. CR00261M), herein incorporated by 
reference in its entirety. 

FIELD OF THE INVENTION 
The present invention relates generally to the field of communication 
systems. In particular, the present invention provides a method of initializing 
training recursions for iterative decoding. 



BACKGROUND OF THE INVENTION 
In a communication system, channel coding schemes may typically be 
employed for error correction. For instance, turbo codes may be used for 
reliable communications over a wireless channel. A variety of methods may 

20 be employed to decode these channel coding schemes. For example, turbo 
codes are generally decoded using an iterative decoding technique. 

Some iterative decoding techniques process results from an underlying 
algorithm. For instance, a maximum a posteriori (MAP) algorithm, a variant 
such as the max-log-MAP or log-MAP, or a similar type of algorithm is 

25 generally used to decode a constituent code within a turbo code. The MAP 
algorithm may be referred to as a decoder. The results from the MAP 
algorithm, such as output log-likelihood ratios (LLRs), can then be used or 
modified for further decoding iterations. The MAP algorithm uses forward and 
backward recursions to update probability metrics and subsequently decode 

30 the constituent code. However, the MAP algorithm requires memory 

proportional to the frame size. In some standards, the frame sizes may reach 
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up to 20,728 bits. Because the memory requirements of the MAP algorithm 
are proportional to the frame size, the amount of memory necessary to 
implement the MAP algorithm is a serious concern. For example, for a frame 
size of 20,728 bits and an eight-state constituent code, 2.65 Mbits of memory 
5 is required. 

To alleviate these memory requirements, windowing techniques are 
frequently employed. In conventional windowing techniques, a frame is 
divided into windows. The MAP algorithm is performed one window at a time 
and thus only requires an amount of memory proportional to the window size. 

10 However, while memory requirements are reduced, these conventional 

windowing techniques may not produce results that are as reliable as those 
produced without windowing. The results are not as reliable because the 
initial conditions for the forward recursion at the beginning of the window or 
the backward recursion at the end of the window are unknown, and must be 

15 estimated through a training procedure. Training recursions are run forward 
from a time before the beginning of the window or backward from a time after 
the end of the window to obtain reliable metric values for the initial conditions 
at the beginning and end of the window. The training period is often set to 32 
or more, which may provide acceptable performance degradation from the un- 

20 windowed MAP algorithm. 

Because the training is required for each window and the training 
period is the same for each window, an increase in the complexity of the 
windowing technique results. In some instances, the training period is equal 
to the window size. This doubles the complexity of a forward or backward 

25 recursion. 

Moreover, because the training period is fixed over all signal-to-noise 
ratios (SNRs) and over all iterations, the training cost remains the same for all 
decoding iterations, even if the complexity of the iteration differs from that of 
the previous or subsequent iteration. 



-3- 



CR00261M - Blankenship et al. 



It would be desirable therefore to provide a method of initialization that 
allows near-optimal performance and that reduces the complexity associated 
with training. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic representation of an information burst decoded in 
accordance with the present invention; 

FIG. 2 is a schematic diagram of a frame-length-W trellis in accordance 
with the present invention; 
10 FIG. 3 is a flow diagram of one embodiment of a method for processing 

a window in an information burst in accordance with the present invention; 

FIG. 4 is a flow diagram of one embodiment of a subroutine of the 
method shown in FIG. 3; 

FIG. 5 is a flow diagram of another embodiment of a subroutine of the 
15 method shown in FIG. 3; 

FIG. 6 is a flow diagram of one embodiment of the internal workings of 
an a recursion block for the /r-th window in accordance with the present 
invention; 

FIG. 7 is a flow diagram of one embodiment of the internal workings of 
20 a (3 recursion block for the fr-th window in accordance with the present 
invention; and 

FIG. 8 shows a schematic representation of one embodiment of a turbo 
decoding system in accordance with the present invention. 

25 DETAILED DESCRIPTION OF THE 

PRESENTLY PREFERRED EMBODIMENTS 

FIG. 1 shows a schematic representation of an information burst that 

may be decoded in accordance with one embodiment of the present invention 

at 100. The term "burst" appearing herein may refer to a short or isolated 

30 transmission, a portion of a longer transmission, a portion of a continuous 
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transmission, a portion of a semi-continuous transmission, a time-limited 
transmission, a bandwidth-limited transmission, or any combination thereof. 

Information burst 100 may include coded or uncoded source 
information. Information burst 100 may comprise any suitable number of 
information symbols. Information burst 100 may be transmitted from any 
suitable transmitting device to any suitable receiving device. For example, 
information burst 100 may be transmitted from a base station to a wireless 
cellular device. Alternatively, a cellular device may transmit information burst 
100 to a base station. 

As seen in FIG. 1, information burst 100 may be processed with one 
embodiment of the present invention. In the embodiment of FIG. 1 , 
information burst 100 has a size of N. Information burst 100 may be divided 
into two or more windows 110, 120, 130. These windows may be of differing 
length. Alternatively, as seen in FIG. 1, the windows 110, 120, 130 may have 
the same length. 

Each window 110, 120, 130 of information burst 100 may be 
processed. For example, a window management function may control the 
processing of each window. In general, the windows may be processed in 
any order. In one embodiment, all windows are processed simultaneously in 
parallel. In another embodiment, the windows are processed from the front of 
information burst 100 to the back of the information burst 100 in sequential 
order. In yet another embodiment, the windows are processed from the back 
of information burst 100 to the front of information burst 100 in reverse 
sequential order. 

FIG. 2 is a schematic diagram of a frame-length-W code trellis in 
accordance with the present invention. Such a diagram may be used, for 
example, by a decoder to denote the possible states through which the 
encoder may have passed. One possible decoder may be the MAP 
algorithm. Alternatively, similar variants of the MAP algorithm may be used. 
In the diagram of FIG. 2, there are eight possible states at each step. 
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Alternatively, there may be more or less states for each step. To generate the 
output of the decoder (such as output LLRs from the MAP algorithm), a typical 
decoder may compute a probabilities for all states between steps 0 and AM, 
inclusive. Alternatively, a typical decoder may compute p probabilities metrics 
5 for all states between steps 1 and N, inclusive. When windowing is used, the 
frame is generally divided into n windows, k = 1,...,n, which may have 
differing lengths. FIG. 2 calls out the Ir-th window in the frame. In the 
embodiment of FIG. 2, the symbols s 0 (k) and s e (k) are used to label the 
starting and ending steps, respectively, of the Ir-th window. These labels are 

10 referenced to the frame step numbers. From this definition, s 0 (1) may equal 
zero (0) and s e (n) may equal N, where N is the frame length. Furthermore, by 
definition So(k+1) = s e (k) and the size of the Ir-th window, W(k), may be 
W(k) = s e (k)-s 0 (k). In the following description, the symbol aj(k), 
j = 0, . . . ,W(k), may denote an ordered set of a's at step j of the Ir-th window. 

15 The elements of the set aj(k) are referenced by a/(fc), where / runs from 1 to 
the cardinality of the set. Also in the following description, the symbol p y -(lc), 
j = 0,. . . , W(k), may denote an ordered set of p's at step j of the Ir-th window. 
The elements of the set p;(lc) are referenced by p/(lc), where / runs from 1 to 
the cardinality of the set. For example, in the embodiment of FIG. 2 the code 

20 has 8 states and the cardinality of the sets aj{k) and Py(lr) is 8. 

FIG. 3 shows a flow diagram of one embodiment of a method of 
processing a window in an information burst in accordance with the present 
invention at 300. A indicates a period before the processing of a window such 
as, for example, window k described above. During period A, a window 

25 adjacent to window Ir, such as, for example, window /r-1 or window lr+1 may 
be processed. Alternatively, during period A, an information burst 100 may be 
divided into windows as described above where window k is processed at the 
same time or before windows k-1 and lr+1 . 

At block 310, a window is selected for processing. This window may 

30 be one of the windows 110, 120, 130 in information burst 100 or window Ir as 
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described above. In one embodiment of the invention, the window may be 
processed using the algorithm shown below: 

■J^p(s\s,y) ^ctjA s '))ff{ s '^ r ( s ) 

1 = In P ^ J = = to "'"*' = Itl Uj ' +} 

J U p( Uj =-l|y) "^P&'W) n ^« J -i(^(^*)PyW 

where the quantity p(s',s,y) may represent a joint probability that a branch of 
5 the trellis goes from state s' to state s during the /-th section of the code trellis 
and the entire received sequence y (e.g., information burst); Lj may represent 
the output likelihood value at section j of the trellis, and u } may be they-th 
information symbol. Because of the underlying Markov nature of the code, 
this probability may be broken up into a product of three probabilities: past 
10 a^O') = p(s',y m<J ), present jj(s',s) = p{s,yj \ s'), and future 

fi^s) = p(y m>J | s) . The notation y m<j may represent the sequence of symbols 

whose position within the sequence is less than / Similarly, the notation y m > y - 
may represent the sequence of symbols whose position within the sequence 
is greater than j. The a and p probabilities may be calculated through 
15 generalized forward and backward recursions, respectively, on the code 
trellis. 

After selecting a window, metric determinations are made for the a 
probabilities (a's) for the beginning state a Q (k) and the (3 probabilities ((3's) for 
the final state $w(k)(k) of the window as seen at blocks 315, 320. Depending 

20 upon how the windows are processed, this may be done by copying metrics 
from adjacent windows or by training. 

In one embodiment of the invention, ao(k) may be determined through 
training for windows k = 2,. .. ,n for block 315. Meanwhile, fiwwik) may be 
determined through training for windows k = 1 , . . . ,n-1 for block 320. This 

25 embodiment may be used, for example, when the windows 110, 120, 130 are 
processed simultaneously in parallel. 
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In another embodiment of the invention, a 0 (k) may be set to equal to 
aiv(fc-i)(fr-1) for windows k = 2,... ,n for block 315. Meanwhile, $w(k)(k) may be 
determined through training for windows k = 1 , . . . , n-1 for block 320. This 
embodiment may be used, for example, when windows 110, 120, 130 are 
5 processed sequentially from the front to the back of the information burst 100. 

In another embodiment of the invention, ao{k) may be determined 
through training for windows k = 2,... ,n at block 315. Meanwhile, fiw(k)(k) may 
be set to equal p 0 (/f+1) for windows k = 1,...,n-1 at block 320. This 
embodiment may be used, for example, when the windows 110, 120, 130 are 
10 processed reverse sequentially from the back to the front of information burst 
100. 

In one embodiment of the invention, determination may occur as 
shown in FIG. 3 (i.e., a 0 (k) determination followed by $w(k)(k) determination). 
Alternatively, determination may occur at block 320 followed by determination 
15 at block 315 (i.e., Pwwik) determination followed by a 0 (k) determination). In 
another embodiment of the invention, block 315 and block 320 may occur at 
the same time. 

Each metric determination block 315, 320 may accept inputs. These 
inputs may be accepted, for example, from a window management function 

20 such as described above. For example, metric determination block 315, 320 
may accept F a and/or F p . F a is a flag that may equal 0 when ao(k) is 
determined from the adjacent window and may equal 1 for determination 
through training. Alternatively, F p is a flag that may equal 0 when $w(k){k) is 
determined from the adjacent window and may equal 1 for determination 

25 through training. 

Metric determination block 315, 320 may also accept ainn(k,i) and/or 
frnit(k,i). ainit(k,i) may be an ordered set of metrics that initializes the a training 
recursion for the #r-th window on iteration #. Alternatively, $init(k,i) may be an 
ordered set of metrics that initializes the (3 training recursion for the #c-th 
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window on iteration /. Note that the elements of the set a;„, f (/c,/) (IWm")) ma Y 
be referenced by a! init (k,i) (pWM), for example, where the index / runs from 
1 to the cardinality of the set. 

Metric determination block 315, 320 may also accept T a (k) and/or 
5 Tp(fr). T a (k) may be the a training period for the fr-th window. T$(k) may be 
the p training period for the Jr-th window. 

At block 325, the as may be computed over the fr-th window. During 
the a recursion over the k-th window, a metrics may be computed that may be 
used to initialize the a training recursions of windows k 1 > k on the following 
10 iteration. This use of the a metrics computed over a window on the /-th 
iteration to initialize the training recursions on the (/'+1)-st iteration is in 
accordance with the present invention. 

At block 330, the p's may be computed over the k-th window. During 
the p recursion over the fr-th window, p metrics may be computed that may be 
15 used to initialize the p training recursions of windows k < k on the following 
iteration. This use of the p metrics computed over a window on the i-th 
iteration to initialize the training recursions on the (/+1)-st iteration is in 
accordance with the present invention. 

In the embodiment of FIG. 3, block 325 precedes block 330. 
20 Alternatively, in another embodiment of the invention, block 330 can precede 
block 325. In yet another embodiment of the invention, block 325 and block 
330 may occur at the same time. 

At block 335, the decoder output, such as LLRs, may be computed 
over the window. This may accomplished using any suitable method known 
25 in the art. Alternatively, the decoder output may be computed within block 
330 when block 325 precedes block 330. In another embodiment, the 
decoder output may be computed within block 325 when block 330 precedes 
block 325. 
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The procedure for using stored metrics from a previous iteration to 
initialize a training period that determines the starting recursion state for the 
window during the current iteration (blocks 315 or 320), and storing metrics in 
a current iteration to initialize a training period in a future iteration (blocks 325 
5 and 330) may be described quantitatively. One such embodiment is 
presented below. 

Let the a and p training periods of the /c-th window be T a (k) and T p (fr), 
respectively. In general, the aj(k) from iteration i can determine the 
a /n /f(/fV + 1) when the equation 
10 Y,W{m) + j = s 0 (k')-T a (k') Eq.(1) 

is satisfied, where k may represent the index of a window. Similarly, the p/fr) 
from iteration / may determine the (W^./'+l) when the equation 

jVM+ j = s e (k')+T fi (k') Eq. (2) 

m=\ 

is satisfied. In one embodiment of the invention, since metrics on the i-th 
15 iteration may influence the initialization of the training recursions on the 

(/+1)-st iteration, the quantities s 0 (*'), *e(#f), 7" o (*0, and TpCO are al1 

measured on the (/+1)-st iteration. 

In general, the a^KM'+l) (P/^./'+l)) may be functions of a/*) (P/*))- 

Previously, the conventional windowing technique uses an equiprobable 
20 initialization 

a l ma (k, i) = p\ m (k, i) =C,\fl,k,i, 
where C is an arbitrary constant that may be independent of a y (lc) (py(fr))- 
In one embodiment, one function is a direct assignment, or 

a/ wf (AC,/+1) = a ; W, Eq.{3) 
25 for all combinations of j, k, and K satisfying Eq. (1) and 

for all combinations of/ fr, and Ar/ satisfying Eq. (2). 
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In another embodiment, 

f Act mm , I = arg max a ' (k) 




Eq. (5) 



for all combinations of/ k, and satisfying Eq. (1) and 

Aa mm = min|a ' (k) - a ] (*)|, 1 = arg max a (k) , 




5 



and 




Ap mOT , / = argmaxp' 7 '(¥) 




Eq. (6) 



for all combinations of / k, and K satisfying Eq. (2) and 

Ap mm =m\r\^(k)-^){k\ / = arg max (}';(*). 



where q runs from 1 to the cardinality of the set and /' runs from 1 to the 

10 cardinality of the set. 

In yet another embodiment, one function may be used for initializing 
a-miik! j+'i) while another function initializes p/™^ ,/+1). In another 
embodiment, an initialization function that can be based on a/fr) may be used. 
In another embodiment, an initialization function that can be based on p/fr) 

15 may be used. 

One of the benefits of the present invention is that near-optimal 
performance may be obtained with smaller training periods than required by 
the conventional windowing technique. This invention may require a modest 
increase in memory. However, in comparison, this increase may be 

20 significantly less than the memory required by the MAP algorithm. 

Additionally, for some embodiments, there may be a small increase in 
complexity for computing a^/f and p/n/KAcV+l) in comparison to the 
equiprobable initialization. However, this increase is offset by the savings due 
to reducing the training period. 
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FIG. 4 shows a flow diagram of one embodiment of a subroutine in 
accordance with the present invention at 400. Routine 400 may be for 
example a subroutine corresponding to the metric determination block 315 for 
the /f-th window described in FIG. 3. The subroutine of FIG. 4 may begin, for 
5 example, at B in FIG. 4. 

At block 405, it may be determined whether F a is equal to 1 . If F a # 1 , 
then the metric determination may occur by copying. In one embodiment, 
oto(fr) may be set to equal to a W ( fc -i)(/f-1) as seen at block 410. 

If F a = 1, then subroutine 400 (e.g., metric determination block 315) 
10 may also indicate that determination will occur by training. In one 

embodiment of the invention, the a's at step s 0 {k)-T a {k) are initialized to 
oimit{k,i) as seen at block 415. This may occur at a point T a (k) steps from the 
beginning of the window. Then at block 425, an a recursion may be 
performed over the T a (k) steps before the initial step of the window up to the 
15 initial step of the window. 

FIG. 5 shows a flow diagram of one embodiment of a subroutine in 
accordance with the present invention at 500. Routine 500 may be, for 
example, the metric determination block 320 for the k-th window described in 
FIG. 3. The subroutine of FIG. 5 may begin, for example, at D in FIG. 5. 
20 At block 505, it may be determined whether F p is equal to 1 . If F p * 1 , 

then the metric determination may occur by copying. In one embodiment, 
Pi*w(/f) may be set to equal to J3o(lf+1) as seen at block 510. 

If F p = 1, then subroutine 500 (e.g., metric determination block 320) 
may also indicate that determination will occur by training. In one 
25 embodiment of the invention, the p's at step s e (k)+Tp(k) are initialized to 

$imt{k,i) as seen at block 515. This may occur at a point T${k) steps from the 
end of the window. Then at block 525, a (3 recursion may be performed over 
the T$(k) steps after the final step of the window up to the final step of the 
window. 
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FIG. 6 shows a flow diagram of one embodiment of the internal 
workings of the a recursion block for the fr-th window in accordance with the 
present invention at 600. In the embodiment shown in FIG. 6, the a ;+ i(fr) may 
be computed recursively from the a/fr) for j = 0, 1 , . . . , W{k)A . However, if a 0 (/f) 
5 determination by training is specified (i.e., F a = 1), then whenever Eq. (1) is 
satisfied, the a,j(k) may be used to compute initial values of a training 
recursions of windows k > k for the following iteration. 

Thus, at block 61 0,y may be set to 0 (\.e.,j = 0). Then at block 615, it 
may be determined whether F a is equal to 1 and whether Eq. (1) is satisfied 
10 for / If F a = 1 and Eq. (1) is satisfied for/ then as seen at block 620, 

ot/^/fV+l) may be computed from aj(k). In one embodiment, block 620 may 
implement Eq. (3) described above. In another embodiment, block 620 may 
implement Eq. (5) described above. In yet another embodiment, block 620 
may implement a function for a /n/f (/f from a,-(fr). Alternatively, a inn {k , ,i+1) 
15 may be computed using any suitable method known in the art. 

At block 625, a y+ i(/c) may be computed from a/fr). This may be 
accomplished using any suitable method known in the art. The information 
computed at block 625 may be handled in any suitable manner known in the 
art. In one embodiment of 625, the results of block 625 may be stored. In 
20 another embodiment, the results of block 625 may be available for computing. 
For example, the results of block 625 may be used to compute LLRs. 

At block 630, j may be set to j + 1 (i.e., j = j + 1 ). Then at block 635, it 
may be determined whether j = W{k). If j is equal to W(k), the routine may 
end. Otherwise, the routine may return to block 615. 
25 FIG. 7, shows a flow diagram of one embodiment of the internal 

workings of the p recursion block for the fr-th window in accordance with the 
present invention at 700. In the embodiment of FIG. 7, the py-i (A:) are 
computed recursively from the p y (Ar) fory'= W(k),W(k)A,...A. However, if 
$w(k){k) determination by training is specified (i.e., F p = 1), then whenever 
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Eq. (2) is satisfied, the p,-(/c) may be used to compute initial values of p 
training recursions of windows k < k for the following iteration. 

Thus, at block 710, j may be set to W(k) ( i.e., j = W{k)). Then at block 
715, it may be determined whether Fp is equal to 1 and whether Eq. (2) is 
5 satisfied for / 

If F p = 1 and Eq. (2) are satisfied for j, then as seen at block 720, 
P/n/f(*V + 1) ma y be computed from Py(Ar). In one embodiment, block 720 may 
implement Eq. (4). In another embodiment, block 720 may implement Eq. (6). 
In yet another embodiment, block 720 can implement a function for p //7 / f (/f',/+1) 
10 from p y (/c). Alternatively, p^(/c',/+1) may be computed using any suitable 
method known in the art. 

At block 725, py-i(/r) may be computed from p;(Jc). This may be 
accomplished using any suitable method known in the art. The information 
computed at block 725 may be handled in any suitable manner known in the 
15 art. In one embodiment of 725, the results of block 725 may be stored. In 
another embodiment, the results of block 725 may be available for computing. 
For example, the results of block 725 may be used to compute LLRs. 

Next, j may be set toy - 1 (i.e., j = j - 1 ) as seen at block 730. Then at 
block 735, it may be determined whether j = 0. If j is equal to 0, the routine 
20 may end. Otherwise, the routine may return to block 715. 

FIG. 8 shows a schematic representation of a turbo decoding system in 
accordance with the present invention at 800. Turbo decoding system 800 
may include at least one log-MAP decoder 810. In the embodiment of FIG. 8, 
turbo decoding system 800 also includes a second log-MAP decoder 840. 
25 Alternatively, MAP or MAP variants may be used instead of log-MAP 

decoders. Turbo decoding system 800 may also include an interleaver 830 
and a de-interleaver 850. 

While specific embodiments of the present invention have been shown 
and described, it will be apparent to those skilled in the art that the disclosed 
30 invention may be modified in numerous ways and may assume many 
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embodiments other than those specifically set out and described above. 
Accordingly, the scope of the invention is indicated in the appended claims, 
and all changes that come within the meaning and range of equivalents are 
intended to be embraced therein. 



